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Background/Aims: Interobserver variation by experience 
was documented for the diagnosis of esophagitis using 
the Los Angeles classification. The aim of this study was to 
evaluate whether interobserver agreement can be improved 
by higher levels of endoscopic experience in the diagnosis 
of erosive esophagitis. Methods: Endoscopic images of 
51 patients with gastroesophageal reflux disease (GERD) 
symptoms were obtained with conventional endoscopy and 
optimal band imaging (OBI). Endoscopists were divided into 
an expert group (16 gastroenterologic endoscopic special- 
ists guaranteed by the Korean Society of Gastrointestinal 
Endoscopy) and a trainee group (individuals with fellow- 
ships, first year of specialty training in gastroenterology). All 
endoscopists had no or minimal expehence with OBI. GERD 
was diagnosed using the Los Angeles classification with or 
without OBI. Results: The mean weighted paired k statistics 
for interobserver agreement in grading erosive esophagitis 
by conventional endoscopy in the expert group was better 
than that in the trainee group (0.51 vs 0.42, p<0.05). The 
mean weighted paired k statistics in the expert group and in 
the trainee group based on conventional endoscopy with OBI 
did not differ (0.42, 0.42). Conclusions: Interobserver agree- 
ment in the expert group using conventional endoscopy was 
better than that in the trainee group. Endoscopic experience 
can improve the interobserver agreement in the grading of 
esophagitis using the Los Angeles classification. (Gut Liver 
2014;8:154-159) 
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INTRODUCTION 

Gastroesophageal reflux disease (GERD) is a condition char- 
acterized by heartburn or regurgitation caused by esophageal 
exposure to acidic gastric content' Due to the increasing preva- 
lence of GERD in Asia, the social and medical importance of 
GERD is increasing. 

Several diagnostic tools have been developed for diagnosis 
of GERD; however, endoscopy is the major tool for assessing 
esophagitis. Detection of erosion or ulcer at the gastroesophgeal 
junction by endoscopy can allow for estimation of patients' 
symptoms and can be used in design of a treatment plan. Sev- 
eral classification systems have been introduced for improve- 
ment of the consistency of diagnosis of GERD.^'^ Los Angeles (LA) 
classification was recentiy introduced and is used as a mainstay 
for diagnosis of erosive esophagitis, because of good correlation 
between esophagitis grade and acid exposure, heartburn sever- 
ity, and risk of symptom relapse.^ '' However, this system also 
has several limitations, including low interobserver agreement 
in trainees and low symptom correlation in endoscopy-negative 
reflux disease (NERD) or minimal change on the gastroesopha- 
geal junction.^'*^ 

The optimal band imaging (OBI) system was developed as a 
new type of computed virtual chromoendoscopy and was intio- 
duced as flexible spectial-imaging color enhancement (FICE) by 
Eujinon Corporation (Saitama, Japan). This system can enhance 
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Fig. 1. (A) A still image obtained 
using conventional endoscopy in a 
patient without erosive esophagitis. 
(B) A still image of optimal band 
imaging in the same patient. 



the mucosal surface and mucosal microvasculature without use 
of dye. Several studies have reported that this system was very 
usefiil for diagnosis of various GI diseases, such as detection of 
depressed-type early gastric cancer and differential diagnosis 
of colonic polyps.'"" Recently, a narrow band imaging (NBI) 
system was found to increase the interobserver consistency in 
diagnosis of GERD.'^ Several previous studies reported that the 
level of experience influenced the interobserver agreement for 
diagnosis GERD by LA classification. But, a study with many 
endoscopists to confirm interobserver agreement to diagnose 
GERD by LA classification is limited. 

In this study, we evaluated that interobserver agreement in 
diagnosis of erosive esophagitis using conventional endoscopy 
with or without OBI can be improved by the level of convention 
endoscopic and OBI system experience. 

MATERIALS AND METHODS 



Table 1. Experience with OBI for the Diagnosis of GERD and Opin- 
ions on the Efficacy of OBI in the Diagnosis of GERD according to 
the Los Angeles Classification 

Expert group Trainee group 

Experience with OBI 

No 14 6 

Minimal 2 4 

Total 16 10 

Opinion for efficacy of OBI 
for diagnosis of GERD 

Good 4 

Mild to moderate 8 

No 2 

Total 14 



1 
7 
2 
10 



Two subjects declined to provide their opinion on the efficacy of OBI 
in the diagnosis of GERD. 

OBL optimal band imaging; GERD, gastroesophageal reflux disease. 



We retrospectively recruited patients with symptoms sug- 
gestive of GERD between January 2009 and December 2009. 
All subjects underwent conventional endoscopy with the OBI 
system using video endoscopy (EG-590WR; Fujinon Corp.). The 
FICE process was performed with R 520 nm, G 500 nm, and B 
405 nm. Fifty-one static photographs of the esophagogastric 
junction were selected according to their resolution. All names 
or dates were removed from the images. 

Twenty-six endoscopists participated in this study for evalu- 
ation of interobserver agreement for diagnosis of GERD. We 
divided 26 endoscopists into two group, expert group and 
trainee group. Expert group was composed of 16 endoscopists 
(gasfroenterologic endoscopic specialist guaranteed by Korean 
Society of Gasfroinetestinal Endoscopy) with more than 4 years 
conventional endoscopy experience and no or minimal OBI 
system experience. Trainee group was composed of 10 endos- 
copists with minimal conventional and OBI system experience. 
Sixteen expert endoscopists were gasfroenterologist specialists 
and 10 frainees were in their first year of specialty fraining in 
gasfroenterology. The definition of minimal experience for OBI 
is defined when endoscopist has expericence for OBI without 
experience for diagnosis of GERD by OBL 



To enhance the consistency in diagnosing GERD, inttoduc- 
tion for OBI system and examples of GERD by OBI system was 
infroduced to investigators before test. The endoscopic grade 
of GERD was determined using LA classification, which was 
presented at a symposium World Congress of Gastroenterology 
in Los Angeles in 1994. Mucosal breaks were graded as normal, 
A, B, C, and D according to the extent. The still image of the 
esophagogastric junction with a ruler was provided in order to 
minimize interobserver variation on examination of the extent 
of the mucosal break. The 51 still images were shown to 26 in- 
vestigators using a video projector for 10 seconds. First, investi- 
gators recorded the grade of GERD by only conventional endos- 
copy image for 51 still images. Second, investigators recorded 
the grade of GERD by conventional endoscopy image and the 
OBI system image. Representative images on conventional and 
OBI endoscopy images are shown in Fig. 1. 

1. Statistical analysis 

Our primary interest was to compare interobserver agreement 
in the interpretation of conventional images with or without 
the combination of OBI system image. The index we used to as- 
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sess this agreement was the k statistic, a measure of agreement 
beyond chance. A K-value greater than 0.8 denoted excellent 
agreement, 0.8 to 0.6 denoted good agreement, 0.6 to 0.4 de- 
noted fair agreement, and less than 0.4 denoted poor agree- 
ment. A p-value of less than 0.05 was regarded as statistically 
significant. The analysis was performed using SPSS version 13.0 
(SPSS Inc., Chicago, IL, USA) and MedCalc (Medcalc Software, 
Mariakerke, Belgium). 

RESULTS 

Endoscopists experience for OBI and opinion on efficacy of 
OBI for diagnosis of GERD by LA classification are shown in 
Table 1. Experience of conventional endoscopy in expert group 



was larger than that of trainee group. But, most endoscopists in 
this study had no or minimal experience in use of OBI in grad- 
ing of esophagitis. 

We obtained 1,326 diagnoses of GERD from 26 endoscopists 
and 51 patients. Erosive esophagitis was diagnosed in 376 
(28.4%) by conventional endoscopy only (Table 2). The numbers 
for grades A, B, C, and D erosive esophagitis by conventional 
endoscopy were 220 (16.6%), 102 [lJ°lo], 39 (2.9%), and 15 
(1.1%), respectively. The most frequent diagnosis in conven- 
tional endoscopy without OBI or with OBI system was normal 
(NERD). 

Erosive esophagitis using conventional endoscopy with OBI 
was increased from 376 (28.4o/o) to 425 (32.1%) (Table 2). Grade 
A erosive esophagitis by LA classification showed an increase. 



Table 2. Correlation between Diagnoses Obtained Using Conventional Endoscopy versus OBI by 26 Evaluators 



Esophageal mucosal changes diagnosed by conventional endoscopy 





Normal 


Grade A 


Grade B 


Grade C 


Grade D 


Total 


Esophageal mucosal changes by conventional endoscopy with OBI 














Normal 


806 


72 


9 


10 


4 


901 


Grade A 


128 


134 


21 


8 




291 


Grade B 


8 


13 


62 


2 


1 


86 


Grade C 


8 


1 


10 


15 


3 


37 


Grade D 








4 


7 


11 


Total 


950 


220 


102 


39 


15 


1,326 



OBI, optimal band imaging. 



Table 3. 

aging 



Weighted Paired k Statistics for Interobserver Consistency in the Grading of Esophagitis in the Expert Group Based on Conventional Im- 



A 
B 
C 
D 
E 
F 
G 
H 
I 
J 
K 
L 
M 
N 
0 
P 



A B C D 

1 0.559 0.264 0.674 

1 0.174 0.574 

1 



E 

0.553 
0.554 
0.325 0.255 
1 0.599 
1 



E 

0.508 
0.516 
0.393 
0.713 
0.539 
1 



G 
0.399 
0.366 
0.426 
0.44 
0.396 
0.489 
1 



H 
0.655 
0.469 
0.351 
0.584 
0.684 
0.579 
0.429 
1 



I 

0.474 

0.385 

0.333 

0.628 

0.624 

0.726 

0.51 

0.554 

1 



J 

0.552 

0.449 

0.397 

0.7 

0.742 

0.641 

0.453 

0.778 

0.621 

1 



K 
0.571 
0.596 
0.244 
0.631 
0.738 
0.629 
0.381 
0.67 
0.606 
0.679 
1 



L 

0.457 

0.635 

0.28 

0.702 

0.543 

0.436 

0.54 

0.4 

0.441 

0.501 

0.49 

1 



M N 
0.629 0.515 



0.537 
0.295 
0.738 
0.651 
0.605 
0.395 
0.598 
0.581 
0.605 
0.592 
0.522 
1 



0.303 

0.315 

0.501 

0.5 

0.402 

0.354 

0.488 

0.513 

0.544 

0.531 

0.394 

0.557 

1 



0 

585 
543 
322 
578 
722 
506 
438 
555 
454 
,511 
506 
729 
583 
492 



P 

0.338 

0.578 

0.192 

0.5 

0.487 

0.462 

0.335 

0.362 

0.349 

0.457 

0.465 

0.557 

0.402 

0.219 

0.469 

1 
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from 220 (I6.60/0) to 291 (21. Wo) after using the OBI system. 
The number of patients diagnosed as normal by conventional 
endoscopy, but diagnosed as grade A esophagitis using OBI was 
128 (43.90/0, 128 of 291). 

The mean weighted paired k statistics for interobserver agree- 
ment in grading of erosive esophagitis in the expert group and 
trainee group by conventional endoscopy was 0.51 and 0.42, 
respectively (p<0.05) (Tables 3 and 4). The proportion of fair 
agreement and good agreement in the expert group by conven- 
tional endoscopy was 48.3% (58 of 120) and 27.5% (33 of 120). 
The proportion of above fair agreement in the expert group 



by conventional endoscopy only was 75.8o/o (91 of 120). The 
proportion of fair agreement and good agreement in the trainee 
group by conventional endoscopy only was 53.3°/o (24 of 45) 
and 8.90/0 (4 of 45). The proportion of above fair agreement in 
the trainee group by conventional endoscopy only was 62.2o/o (28 
of 45). 

The mean weighted paired k statistics in the expert group 
and trainee group by conventional endoscopy with OBI was 
0.42 and 0.42, respectively (Tables 5 and 6). The proportion 
of fair agreement and good agreement in the expert group by 
conventional endoscopy using OBI was 34.1o/o (41 of 120) and 



Table 4. Weighted Paired k Statistics for Interobserver Consistency in the Grading of Esophagitis in the Trainee Group Based on Conventional Im- 
aging 

123456789 10 

1 1 0.579 0.575 0.524 0.417 0.375 0.318 0.477 0.311 0.463 

2 1 0.609 0.332 0.563 0.402 0.468 0.56 0.437 0.33 

3 1 0.328 0.452 0.452 0.457 0.609 0.421 0.491 

4 1 0.362 0.321 0.198 0.25 0.383 0.559 

5 1 0.48 0.286 0.617 0.485 0.493 

6 1 0.338 0.462 0.409 0.362 

7 1 0.32 0.252 0.229 

8 1 0.568 0.453 

9 1 0.616 
10 1 



Table 5. Weighted Paired k Statistics for Interobserver Consistency in the Grading of Esophagitis in the Expert Group Based on Conventional Im- 
aging with OBI 





A 


BCD 


E 


F 


G 


H 


1 


J 


K 


L 


M 


N 


0 


P 


A 


1 


0.755 0.325 0.763 


0.654 


0.508 


0.42 


0.669 


0.368 


0.637 


0.333 


0.645 


0.676 


0.286 


0.343 


0.653 


B 




1 0.39 0.791 


0.477 


0.35 


0.323 


0.496 


0.364 


0.505 


0.199 


0.589 


0.625 


0.234 


0.342 


0.649 


C 




1 0.429 


0.224 


0.25 


0.38 


0.282 


0.111 


0.268 


0.132 


0.409 


0.207 


0.213 


0.205 


0.363 


D 




1 


0.57 


0.44 


0.366 


0.53 


0.351 


0.511 


0.283 


0.7 


0.593 


0.317 


0.373 


0.691 


E 






1 


0.444 


0.343 


0.631 


0.412 


0.607 


0.406 


0.545 


0.635 


0.366 


0.468 


0.503 


F 








1 


0.284 


0.481 


0.375 


0.498 


0.448 


0.414 


0.481 


0.377 


0.326 


0.293 


G 










1 


0.362 


0.192 


0.372 


0.186 


0.434 


0.344 


0.176 


0.233 


0.545 


H 












1 


0.486 


0.802 


0.526 


0.62 


0.586 


0.453 


0.465 


0.409 


I 














1 


0.5 


0.353 


0.375 


0.537 


0.368 


0.328 


0.21 


J 
















1 


0.488 


0.538 


0.61 


0.498 


0.398 


0.368 


K 


















1 


0.249 


0.322 


0.477 


0.328 


0.154 


L 




















1 


0.561 


0.329 


0.477 


0.561 


M 






















1 


0.417 


0.372 


0.463 


N 
























1 


0.299 


0.177 


0 


























1 


0.282 



p 1 



OBI, optimal band imaging. 
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Table 6. Weighted Paired k Statistics for Interobserver Consistency in the Grading of Esophagitis in the Trainee Group Based on Conventional Im- 



aging with OBI 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


1 


1 


0.415 


0.605 


0.529 


0.321 


0.466 


0.418 


0.319 


0.598 


0.438 


2 




1 


0.428 


0.422 


0.409 


0.368 


0.474 


0.238 


0.493 


0.472 


3 






1 


0.394 


0.389 


0.455 


0.522 


0.311 


0.601 


0.447 


4 








1 


0.313 


0.476 


0.37 


0.259 


0.512 


0.504 


5 










1 


0.246 


0.561 


0.247 


0.417 


0.433 


6 












1 


0.343 


0.275 


0.578 


0.417 


7 














1 


0.364 


0.585 


0.424 


8 
















1 


0.45 


0.345 


9 


















1 


0.67 


10 




















1 



OBI, optimal band imaging. 



150/0 (18 of 120). The proportion of above fair agreement in the 
expert group by conventional endoscopy only was 49.1o/o (59 
of 120). The proportion of fair agreement and good agreement 
in the trainee group by conventional endoscopy using OBI was 
57.50/0 (26 of 45) and 6.60/0 (3 of 45). The proportion of above 
fair agreement in the trainee group by conventional endoscopy 
only was 64.4o/o (29 of 45). 

DISCUSSION 

GERD can be diagnosed by several diagnostic modalities, in- 
cluding traditional endoscopy, pH testing, and questionnaire. So 
far, the diagnosis of GERD using endoscopy is a mainstay in the 
clinical field; LA classification system is a popular system for 
grading the esophagitis. Interobserver variation for diagnosis of 
GERD using LA classification and virtual chromoendoscopy (NBI) 
was recently introduced by Lee et al'^ But, no study regarding 
diagnosis of GERD using traditional endoscopy with OBI has 
been reported so far. 

We conducted this study in order to confirm whether endo- 
scopic experience could influence interobserver consistency for 
diagnosis of GERD by LA classification and for evaluation of 
whether OBI could improve interobserver consistency for diag- 
nosis of GERD in each expert and trainee endoscopist group. 
Interobserver consistency with conventional endoscopy showed 
fair agreement (0.41 to 0.60) in both groups. However, consis- 
tency in the expert group was better than that in the trainee 
group (0.51 vs 0.42, p<0.05). In addition, the proportion of the 
above fair agreement with conventional endoscopy in the ex- 
pert group was better than that in the ttainee group (75.8o/o vs 
62.20/0). This result is sinular to those of several previous stud- 
ies.^'^ 

Interobserver consistency for diagnosis of GERD using con- 
ventional endoscopy with OBI showed fair agreement in both 
groups. The consistency was 0.42 in both groups. The propor- 



tion of the above fair agreement in the expert group and the 
trainee group was 49. l°/o and 64.4o/o, respectively. 

We think that OBI cannot improve the consistency of GERD 
diagnosis because of the following problems. First, most observ- 
ers have no or minimal experience in use of OBI system for 
diagnosing GERD. The proportion of those who have experience 
in use of OBI system was 12. 50/0 and 40o/o in the expert group 
and the trainee group, respectively. The lack of experience in 
use of OBI system in the expert group may influence the reduc- 
tion of interobserver consistency after adding OBI images. 

A previous study on experience in performance of virtual 
chromoendoscopy concluded that diagnostic accuracy could 
improve for less-experienced endoscopists after participation 
in an expanded training program.'^ Thus, study to determine 
whether a training program for OBI can improve diagnostic ac- 
curacy and interobserver consistency is needed. 

Secondly, we used a stUl image instead of video image in 
grading of esophagitis by LA classification. In addition, time 
duration of the slide was only 10 seconds. This method may in- 
fluence the negative effect for interobserver consistency. 

In conclusion, experience in diagnosis of GERD by endoscopy 
improves interobserver agreement in grading of esophagitis by 
LA classification. 
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